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A study was conducted at the Community College of 
Philadelphia (CCP) to evaluate the college's effectiveness in 
developing students' self-confidence and sense of individual 
responsibility. Two paper-and-pencil instriunents were selected for 
use in the study: the Self Concept Scale (SCS), which measured 
decision making, interpersonal relations, responsibility, 
citizenship, and career planning; and the Affective Perceptions 
Inventory (API), which measured school perceptions and self -concept . 
The instruments were completed in class or at graduation rehearsal, 
with 601 students responding to the SCS and 613 completing the API. 
Study findings included the following: (1) analysis of SCS responses 
indicated that sophomores rated their level of self -concept 
significantly higher than freshmen, with the largest differences 
associated with decision making and interpersonal relations; (2) 
freshmen rated themselves lowest in the areas of decision making and 
interpersonal skills and highest in citizenship and responsibility; 
(3) sophomore ratings on the API scale were significantly higher on 
all subscales than those of freshmen; and (4) the difference between 
the ratings of freshmen and sophomores was greatest for students in 
non-General Studies programs. (UCM) 
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The basis for this research project was a charge given to 
the Institutional Effectiveness Task Force several years ago. 
This task was the identification of institutional eif ect iveness 
aeasures related to student outcooes that went beyond traditional 
measures such as transfer or graduation rates. 

The nembers of the Task Force, at that time, developed 
several recommendations, one of which was the need to determine 
if student growth occurs in affective areas during enrollment at 
CCP. An extensive list of potential areas of personal 
development was compiled. The Objectives for General Education, 
prepared by the General Education Task Force, served as the 
source document for selecting the most appropriate non-cognitive 
areas of expected student development from the original list. 
For a first attempt, the Committee focused specifically on 
Objective 10, which states, "Students should develop self- 
confidence and a sense of individual responsibility." 

A literature review and conversations with colleagues from 
other colleges and universities indicated that in spite of the 
expectation that students will experience personal growth through 
their educational involvement at their institutions, few schools 
have attempted to evaluate student development in affective 
areas. Most of the research of this type has been conducted at 
bachelor-degree granting institutions. Astin (1978), for 
example, found that after four years of college, students had 
more positive self-images, and a greater self-awareness and 
understanding of their abilities and limitations. Terenzini et 
al. (1981) found that most personal development of students 
enrolled at a four-year college occurred during their freshmen 
and sophomore years. They also found that informal out-of-class 
interactions with faculty members contributed to gains in 
p erson a 1 growth. 

The lack of success in locating a re pi i cable community 
college research model necessitated starting from scratch in 
designing a study that would evaluate institutional effect iveness 
in achieving the commitment to the development of student self 
concept. 

Inst rmment ation 

After an extensive search, a small committee of the Task 
Force iJentified two paper and pencil instruments that came 
closest to measuring self concept, as defined in cur 
institutional documents. The Self Concept Scale (SCS), the 
shorter of the two surveys, consisted of five subscales; 
Decision Making, Interpersonal Relations, Responsibility , 



Citizenship and Career Planning. The survey containei 50 items 
totally, 10 for each subscale. Responses fell along a six-point 
scale, one indicated a highly unfavorable response, while a six 
indicated a highly favorable response. 

The second instrument was the Affective Perceptions 
Inventory (API), which consisted of three subscales: Student 
Self, School Perceptions and Self Concept. The scale consisted 
of 84 items, 25 items were associated with the Student Self and 
Self Concept subscales and 34 itemr were included in the School 
Perceptions subscale. The response categories in this instance 
were one to four. The lowest value was least positive, the 
highest value was most positive. 

A secondary issue that was addressed by the Committee in 
this study was the appropriateness of these instruments for our 
institution. These recommendations appear in Appendix A. 

Methodology 

The SCS and API were pilot-tested during the last half of 
the Spring 1986 semester. Classes, which served as the sampling 
unit, were stratified by day/evening, and 1 00-/200-1 evel in order 
to insure an appropriate mix within the sample. 

In all, 60 sections of classes were randomly selected for 
participation, 30 received the SCS and 30 the API. 

Instructors were requested to allow class time for 
completion of the 20-minute surveys and instructed to return the 
forms to the Institutional Research Office. A two-week period 
during the semester was given as a time frame for class 
participation. Replacement classes were chosen in the few cases 
where instructors were unable to participate because of limited 
class time. 

In additio to class participation, a second survey 
sampling technique was used in this study. Spring 1986 graduates 
who attended commencement rehearsal were requested to complete 
one of the two surveys. The data collection techniques used in 
this study therefore provided a broad perspective of student self 
concept ratings. The classroom surveys provided new and 
continuing student information, while the commencement rehearsal 
surveys rounded out the data with graduate information. 

A total of 601 students completed the SCS and 613 filled 
out the API. Based on enrollment on-campus, the numoer of 
participating students (1,214) reprenented approximately 11.3% of 
the Spring 1986 student body. 



Data An«lyl« 



Data analysis proceeded from a value-added perspective. 
Since a longitudinal study design vas not possible because of 
time and financial constraints, a cross-sectional analysis vas 
undertaken. Students enrolled In Spring 1986 were dichotomized 
Into those who completed fewer than 25 registered hours as of 
Spring 1986 and those who completed 25 or nore hwurs. For 
analytic purposes, students In the foraer group were labeled 
freshaen and those in the latter group were considered to be 
a ophoBores . 

Scale results were analyzed separately for two progran 
categories: General Studies and all other College curricula. 
This curriculum breakdown was used for several reasons. General 
Studies was selected for separate analysis because of the current 
Institutional Interest In redesigning the curriculum. Any 
evaluative Information concerning the strengths or weaknesses of 
the program will hopefully promote understanding and positive 
change In this effort. 

Methodological concerns about sample sizes restricted the 
definition of the comparison group to all other College 
currlcul a. 

In terms of main effects. It was hypothesized that from an 
Institutional effectiveness perspective, sophomores In general 
would rate their level of self-concept higher than fr-shmen. 
Based on differences In academic trends of General Studies and 
non-General Studies students that were reported lu the General 
Studies Academic Audit, It was hypothesized that sophomores In 
non-General Studies programs, would report higher levels of self- 
concept than General Studies sophomores. 

Profile of Sample 

Cumulative earned registered hours as of Spring 1986 were 
used to measure the passage of time In this study. Summary 
statistics that reflect the distribution of this variable In the 
sample appear In Figure 1. 

FIGURE 1 

Mean and Median Cumulative Registered 
Hours Completed by Freshmen and Sophomores 

M*«P Median 



Freshmen 13.9 q 

Sophomores 56.7 53. 0 
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Based on Figure 1 information, it appears that the 
approach used to define the study groups was successful in 
splitting the sample into two discrete, heterogeneous groups. 
Freshmen and sophomore means and medians are sufficiently 
different to insure the two groups differed with regard to the 
extensiveness of instructional time they have experienced at CCP. 

Additional demographic and academic information was 
included in the data set in order to build a profile of the 
s Amples. 

Nearly two-thirds (65. 6Z) of the freshmen sample and 
almost three-quarters (72.51) of the sophomore group were 
females. The median age for freshmen was 22, 26 for sophomores. 

" Fifty-two percent (52X) of the freshmen were Black, 32% 
White, 10. 2Z Asian and 4.4Z Hispanic. Among the soohomore 
sample, 59% were Black, 30Z White, 4.82 Asian and 4l9Z Hispanic. 
The percentage of freshmen and sophomores with an unknown race 
status was 1.4Z and i.35;, respectively. 

- Thirty-two percent (32%) of the freshmen sample and 3SX 
of the sophomores were enrolled full-time during the Spring 1986 
s emest er. 

Both freshmen and sophomore groups had a median reading 
placement score of 31. 

The median cumulative grade point average calculated 
over all enrolled semesters up to Spring 1986 was 2.5 for 
freshmen and 2.7 for sophomores. 

Based on previour Institutional Research, these sample 
student profiles appear to be fairly representative of on-campus. 
College-wide Spxing 1986 enrollments. Notable exceptions are the 
over-representation of Asian students among the freshmen sample 
(ESL course sections were somewhat over-represented among the 
sampling units). 

Compared to College-wide figures, the median reading 
placement test scores for the sample are rather high, especially 
for freshmen, indicating that the study results may not 
accurately represent Project II students. 

Full-time students may be slightly under-represented in 
the samples . 
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Results 



Student Self Concept scores were computed for both 
freshmen and sophomore samples. Several inappropriate subscale 
items were elftoinated from both instruments during data analysis. 
Subscale and total scale figures were calculated by summing 
across associated scale items and dividing by the number of items 
used to construct the subscales. The original range and 
interpretation of the scale was therefore unchanged, one to six 
for the SCS and one to four for the API* Higher scores on both 
scales indicate more positive feelings of self concept. Surveys 
with missing item information were eliminated from the associated 
subscale analyses. 

The major focuses of analytic interest were the 
differences between sophomore and freshman self-ratings, and the 
relative scale positions of freshmen and sophomore ratings. 

Self Concept Scale 

Results of the total Self Concept Scale indicate that 
sophomores rate their level of self concept significantly (p<aOS) 
higher than freshmen (Table 1) The calculated difference between 
the two ratings is C.1918 (Table 2). 

Analyses of individual subscales indicate that the largest 
difference between sophomore and freshmen ratings is associated 
with Decision Making (.03^66), followed in magnitude by 
differences on the Interpersonal Relations (0.2399), 
Responsibility (0.1299), Citizenship (0.1174) and Career Planning 
(0.104) subscales. The first three subscale differences were 
significant. 

In terms of position on the scales, freshmen rate 
themselves lowest in the area of Decision Making and Inter- 
personal Skills and highest in Citizenship and Responsibility. 
It is therefore not surprising that the highest sophomore ratings 
were also in Citizenship and Re sponsibi lit y . It is interesting 
that freshmen ratings on the Decision Making and Interpersonal 
Relations subscales were considerably lower than the other 
freshmen subscale ratings, but the sophomore ratings in these 
areas eventually converged with the other sophomore ratings. 
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Based on results of this survey. It appears that CCP 
students* decision-making and interpersonal relations skills are 
the Bost dynamic over the course of their CCP enrollment. Career 
planning is clearly the weakest area of student progression with 
little demonstrated difference in freshmen/sophomore ratings. 

Affective Perceptions Inventory 

Results of the Affective Perceptions Inventory (Table 3) 
In many ways parallel those of the SCS. Sophomore ratings on the 
Total Scale are significantly higher than freshmen ratings. 
Differences on the three subscales were all in the expected 
direction. Freshmen/sophomore 'Jifferences were significant on 
the Student Self and Self Concept subscales. Tne third subscale. 
School Perceptions, produced a small, non-significant difference 
in the expected direction. 

Freshmen rate themselves at approximately the same point 
on the Total Scale and the Self Concept and Student Self 
subscales. They rate themselves slightly higher on the School 
Perceptions Scale. Sophomore positioning is more heterogeneous 
across the scales. Sophomores rate themselves highest on the 
Student Self Scale, followed in order of magnitude by the 
Decision Making and School Perceptions subscales. 
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Scale Rfegulf fo r General Studies Versus Other College Curricula 



Slightly more than one-quarter (27. 5X) of the overall 
sample was enrolled in General Studies in the Spring 1986 
senester. Fifty-six percent (56Z) of the freshmen sample was 
General Studies, while considerably fewer of the sophomore 
(20.9Z) students were classified in this group. This may be due 
to the shorter retention rates associated with General Studies 
students and the tendency to use General Studies as a temporary 
curriculum choice for many of the aspiring selective College 
program students. 

Survey results for the two curricular groups appear In 
Tables 5 through 8. 

The difference between freshmen/sophomore Total Self 
Concept ratings is greater for students in non-General Studies 
programs. This result was consistent over the anfilysis of both 
Inst rument s . 
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Analyses of the survey subscales indicated a similar 

c«rrlcular types. The Interpersonal 
Relations (SCS). Citizenship (SCS) and Student Self (API) 
subscales yielded the most interesting comparative Information. 

The most striking difference between the two groups is in 
the area of Interpersonal Relations (SCS). Clearly, the largest 
difference (0.371) in freshmen/sophomore ratings for all other 
programs was associated with this subscale. By comparison the 
General Studies difference (0.0782) was .odest. It is also 
interesting that while non-General Studies freshmen ratings in 
this area were lower than their General Studies counterpart, the 
uon-General Studies sophomore rating exceeds the General Studies 
sophomore rating. 

Group differences were also considerable on the 
Citizenship (SCS) subscaie. While freshmen ratings across groups 
were approximately the same. non-General Studies sophomore 
"tln|s "^'^ considerably higher than General Studies sophomore 

, *!!f pattern appears in the analysis of the Student 

Self (API) and Self Concept (API) subscales. 

On the Decision Making (SCS) subscaie. there were sizable 
demonstrated differences in freshmen/sophomore ratings for both 
curricular groups, slightly larger differ«;nces were associated 
with the General Studies group. 

General Studies students also exhibited a larger 
f resnmen/sophcmore difference in the area of Career Planning 
(SCS). In fact. Career Planning and School Perceptions (API) 
were the only areas in which General Studies sophomore ratings 
exceeded those associated with non-General Studies sophomores. 

Responsibility (SCS) and School Perceptions (API) 
represented areas of weak performance for both groups. 

Pi Bcussi on 

This study was a first attempt to understand non-cognitive 
student outcomes at CCP. While the differences in student 
ratings at two points in time were modest, they were uniform over 
two independent survey instruments, significant in a number of 
cases and consistent with the College Mission Statement, the 
General Education Objectives and the results of research 
conducted by others. 
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The quasi-experimental nature of this research 
necessitates a cautious approach In the analysis of results. 
While the use of a cross-sectional sample does not allow for the 
interpretation of dependent variables as student gains per se. It 
does allow for. legitimate comparison of two discrete student 
groups who differ in a variety of ways, most Importantly In terms 
of length of CCP enrollment. 

The results of this study appear more credible when viewed 
in concert with the research findings of Astln and Terenzlnl, 
Which appear in a previous paragraph, and with previous CCP 
Institutional Research. The General Studies Academic Audi t 
indicated that despite the fact that General Studies students 
enter the College with abilities that are essentially the same as 
students in other programs, their academic performance, as 
measured by graduation rate, GPA and transfer outcomes are 
significantly lower. 

These trends in academic differences for students enrolled 
in General Studies and other college programs appear to hold up 
In the non-cognitive realm as well. Terenzlnl demonstrated the 
importance of Informal, out-of-class faculty interaction 1" the 
development of student personal growth. The following point was 
raised in the General Studies Audit and appears to support 
Terenzlni's observation: "Placing students in the General Studies 
program reduces the possibility for more extended contact with a 
small group of faculty that frequently occurs in the other 
program areas. All General Studies students should perceive that 
they are being supported or mentored by some individual or group 
within the College." The results of this non-cognitive study 
reinforce the Importance of this suggestion. 

This first effort to explore student gains in non- 
cognitive areas has proven to be a productive exercise. Future 
research in this area could be improved in several ways. A 
longitudinally designed study in which individual students are 
tracked over Mme would yield actual measures of student gains 
which would be a preferable unit of analysis to the 
f reshmen/sophc^ore differences that were available from this 
c ross-s ecti'inal study. 

The use of more meaningful instrumentation would 
strengthen this type of research effort. While the use of 
natlonally-normed tests provide the advantage of Instruments with 
proven track records in the field, these r.«8ts do not take into 
account the idiosyncrasies of a specific sample. Many times the 
wording or Item content is not appropriate for local use. An 
Instrument developed in-house would therefore allow for a more 
precise measure of the aJfectlve area of research interest. 
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It is possible that greater change might have been 
observed for subscales had the range of responses allowed for 
more variation. A s^x-point scale was used on the SCS and a very 
restrictive f our-po: nt scale on the API. 

There is alec evidence that a '^ceiling effect" is in 
operation which is pr venting a greater demonstrated difference 
in some freshmen/sophomore ratings. In several cases, the 
subscales with the highest freshmen ratings demonstrated the 
Smallest difference: , 

Larger sample sizes would allow more reliable sub- 
population analyses, such as more detailed curriculum comparisons 
than the approach used in this study. 
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APPENDIX A 



Selection Process for Instruaents Used 

The Institutional Effectiveness Task Force and its 
Subcommittees, through the course of extensive meetings, 
developed lists of Indicators, that Is, behaviors, attitudes and 
skills, which could be used to determine to what extent CCP Is 
effective. These extensive lists of Indicators were then put In 
priority order. The Institutional Effectiveness Steering 
Committee was then left with the task of determining how to 
measure these Indicators. The decision was reached to begin with 
measures which already exist. The Steering Committee recognlred 
that a great deal of time and effort would be required to develop 
new measures. At the same time, we recognized that we had to 
test out the Indicators themselves to ascertain If, In fact, they 
could tell us anything of significance about the College. 

Educational Testing Service (ETS), In Princeton, New 
Jersey, serves as a repository for tests and test Information. 
We obtained from them copies of appropriate test bibliographies 
and, from these lists, selected those Instruments which seemed 1) 
to address the Indicators In which we were Interested, 2) to be 
designed for the appropriate level, 3) to be relatively up-to- 
<:.te and, 4) to have technical documentation. When this process 
was completed, hundreds of tests remained. The Steering 
Committee then arranged to visit the Test Collection Library at 
ETS to examine this group of Instruments. 

Closer examination of each Instrume^it and Its technical 
manual allowed us to eliminate many of them. Some required far 
too ouch time to administer; some were extremely expensive; some 
had been developed and used only with very small and 
Inappropriate groups; some had unconvlnclni; documentation; some 
seemed not to measure what tney professed to measure; and some 
had extremely sophisticated reading comprehension levels. We now 
were left with about a dozen tests to consider. 

Upon our return to CCP, we ordered specimen sets of those 
scales, surv<fys and tests In which we were still Interested. 
When they arrived, each member of the Steering Committee reviewed 
them at great length. We then met to discuss our evaluation of 
the Instruments and to select those which could be administered 
In the time and manner which ve had chosen for this study. We 
agreed, after this entire process had been completed, that none 
of the Instruments did exactly what ve wanted. However, a 
combination of measures seemed to approximate the Instrument for 
which we were looking. Therefore, albeit with reservations, we 
selected the Self Concept Scale , from Dallas Educational Services 
and the Se If Concept , School Perception , and St udent Self scales 
from Scares Associates. 



The process of trying to select an Instrument to measure 
constructs which we determined were Important was both 
frustrating and edifying. Our conclusion Is that, for our 
purposes, In the future we will probably need to Invest the time, 
money, and energy to develop our own 1 nst rument (s ) to be used In 
non-cognlt Ive assessment. 




ERIC Clearinghouse for 
Junior Colleges 2 0 1988 



mmftmnnxnuM 



